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1.  SCOPE.  This  TOP  introduces  Volume  10  of  test  operations  procedures.  It 
identifies  equipment  items  in  the  following  categories:  food  and  food  prepara¬ 
tion;  fuels  and  servicing  units;  shelters;  general  and  special  purpose  clothing 
and  equipment;  heating,  cooling  and  ventilating  equipment;  photographic,  print¬ 
ing  and  optical  equipment;  and  miscellaneous  support  equipment.  It  also  iden¬ 
tifies  some  of  the  test  considerations  to  be  addressed  during  the  life  cycle  of 
general  supplies  and  equipment.  Policies  and  documents  governing  testing  are 
also  discussed. 


Volume  10  covers  the  testing  of  general  supplies  and  equipment  used  by  the 
Army.  These  can  be  grouped  according  to  the  principal  functions  they  perform: 

a.  Food  and  food  preparation.  These  are  items  of  ration  and'  means  of 
food  preparation  for  troop  use.  This  category  includes  the  following: 


(i)  Individual  field  mess  equipment. 


(2)  Baking  and  roasting  ovens. 

(3)  Field  kitchens  and  cooking  equipment. 
(U)  Combat  rations. 

(5)  Complete  rations. 

(6)  Individual  food  items. 

•This  TOP  supersedes  TOP  I-I-0U5  dated  17  March  1Q72. 
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(7)  Preparation  methodr  and  equipment  for  food  service. 

b.  Fuels  and  servicing  units.  These  items  consist  of  militai'y  fuels, 
oils,  additives  for  converting  fuels  to  flame  warfare  use,  and  vehicle  servic¬ 
ing  and  lubrication  units.  The  following  items  are  included: 

(1)  Diesel,  MOGAS,  aviation,  and  turbine  fuels. 

(2)  Fuel  thickeners,  flame  throwers. 

(3)  Lubrication  and  servicing  equipment. 

c.  Shelters.  This  equipment  is  used  to  provide  military  personnel  and 
equipment  protective  shelter  under  varying  environmental  conditions.  This 
category  includes  the  following: 

(1)  Prefabricated  buildings. 

(2)  Tents  and  shelters. 

(3)  Foamed-in-place  shelters. 

(L)  Air-inflated  or  supported  structures. 

(5)  Expandable  auid  contained  structures. 

M 

'  (6)  Aircraft  maintenance  shelters. 

d.  General  and  special  pui^iose  clothing.  These  items  clothe  amd  protect 
military  personnel  engaged  in  combat  activities  and  special  phases  thereof. 

This  category  includes  the  following  items: 

(1)  Combat  uniforms,  helmets,  and  boots. 

(2)  Protective  equipment,  masks,  gloves,  and  liners. 

(3)  Head  and  body  armor. 

(U)  Aviation  and  armored  vehicle  crewmen  uniforms. 

(5)  Foul  weather  gear. 

(6)  Diving  suits  and  masks. 

(7)  LASER  safety  goggles. 

e.  General  amd  special  pui^jose  equipment.  Such  equipment  items  are  many 
and  varied.  They  are  used  to  support  military  personnel  and  units  and  the  tac¬ 
tical  field  operations  in  which  they  are  engaged.  This  category  includes  the 
following: 

(1)  Individual  load-carrying  devices. 

(2)  Sleeping  gear. 
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(3)  Fire  extinguishers  and  fire-fighting  equipment. 

(U)  Boats  and  waterway  equipment. 

(5)  Maintenance  and  special-purpose  repair  shops. 

(6)  Survival  and  life-saving  equipment. 

f.  Heating,  cooling,  and  ventilating  equipment.  This  equipment  provides 
body  comfort  for  military  personnel  and  controlled  environments  for  operation 
of  specialized  equipment.  The  following  items  are  included: 

(1)  Ducted  and  ncn-ducted  heaters. 

(2)  Refrigeration  and  air-conditioning  equipment. 

(3)  Fans  and  blowers. 

(U)  Dehumidifiers. 

(5)  Boilers  and  furnaces. 

g.  Photographic,  printing,  and  optical  equipment.  This  specialized 
equipment  assists  military  personnel  and  units  in  performing  tactical  field 
operations.  The  following  items  are  included: 

(1)  Binoculars,  telescopes,  and  optical  devices. 

(2)  Metascopes  and  image-intensification  devices. 

(3)  Theodolites  and  surveying  instnnnents . 

{U)  Cameras,  photographic  printers  auid  equipment. 

(5)  Projection  equipment. 

(6)  Stereoscopic  devices. 

(7)  Field  printing  equipment. 

h.  Miscellaneous  support  equipment.  A  variety  of  equipment  is  required 
to  support  logistic  and  service  function*  of  military  units  and  personnel. 

Some  of  these  are: 

(1)  Containers  and  pallets. 

(2)  Ice-making  machinery. 

(3)  SCUBA  diving  equipment. 

(4)  Vector-control  equipment. 

(5)  Remains  pouches  and  identification  systems. 
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(6)  Packaging  and  preservation  equipment. 

(7)  Air  drop  support  equipment. 

(8)  Drafting  and  mapping  equipment. 

2.  OVERALL  TEST  PHILOSOPHY.  General  equipment  items  may  be  subjected  to  any 
of  the  tests  described  in  AR  70-10‘*  and  AR  700-86.’  Tests  primarily  germane 
to  commodities  of  TOP  Volume  10  are  technical  and  user  types.  A  distinction 
must  be  made  between  programmatic  testing  and  testing  considerations. 
Programmatic  testing  is  the  name  given  to  the  test  phase  in  relation  to  the 
type  of  decision  to  be  made.  Basically,  there  is  technical  testing  and 
user/customer  testing. 

a.  Technical  tests  (IT)  are  conducted  by /under  the  supervision  of  an  in¬ 
dependent  test  activity,  not  a  part  of  the  developing  agency  concerned,  in  ac¬ 
cordance  with  the  controlled  conditions  and  criteria  established  in  a  test 
plan.  The  purpose  of  technical  tests  is  to  assess  the  technical  performance 
and  safety  characteristics  of  an  item/system  and  its  associated  system  support 
packag's  (SSP)  as  described  in  requirements  documents  and  as  indicated  by  the 
particular  design.  Technical  tests  generally  require  instrumentation  and 
measurements  performed  by  engineers,  technicians,  or  soldier  operator- 
maintainer  test  and  evaluation  (SCMTE)  personnel.  (Refer  to  AR  700-127’  for 
SSP  definition  and  test  objectives.)  This  determination  includes  measuring  the 
inherent  mechanical,  electrical,  or  other  physical  amd  chemical  property  or 
technical  characteristic,  and  may  use  data  previously  generated  during  engineer 
design  tests  (EDT).  The  TT  is  characterized  by  controlled  conditions  auid  the 
elimination  of  human  judgment  error  so  far  as  possible,  through  the  use  of  en¬ 
vironmental  chambers;  physical  measurement  techniques;  controlled  laboratory, 
shop,  and  field  trials;  statistical  methodology;  and  use  of  personnel  trained 
in  the  engineering  or  sc’entific  fields.  The  TT  provides  data  for  use  in  fur¬ 
ther  development  as  required,  and  for  determinations  of  the  safety,  technical 
and  logistic  support ability  of  the  item  or  system  for  the  operational  test. 

b.  User  tests  (UT)  are  conducted  with  troops  representative  of  those  vrtio 
will  operate  the  equipment.  The  materiel  being  tested  is  operated  under  simu¬ 
lated  tactical  conditions  or  conditions  similar  to  those  expected  during  in¬ 
tended  operational  use.  The  purpose  of  the  UT  is  to  determine  whether  the 
materiel  is  suitable  for  its  intended  use  by  measuring  how  well  the  materiel 
meets  performance  standards  established  in  the  requirements  documents,  auid  tes¬ 
ting/assessing  the  training  and  system  support  packages.  The  UT  includes  a 
tactical  unit  equipped  with  the  materiel  during  a  controlled  field  exercise  to 
provide  data  on  the  overall  item/unit  effectiveness  or  military  worth  as  input 
to  the  evaluation  process.  Consideration  is  given  to  verifying  doctrine,  or¬ 
ganization  and  tactics,  basis  of  issue,  logistical  rupport,  and  training 
requirements.  The  UT  is  characterized  oy  qualitative  observations  and  judg¬ 
ments  of  selected  military  personnel  who  have  a  background  of  field  experience 
with  a  type  of  materiel  similar  to  that  undergoing  tests.  Instrumentation  is 
limited  to  measuring  characteristics  of  major  operational  significance. 

•Superscript  numbers  correspond  to  reference  numbers  in  Appendix  A. 
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c.  Environmental  tests  are  conducted  to  determine  whether  an  item  will 
perform  effectively  in  the  environments  in  which  used.  The  most  important 
policies  auid  criteria  regarding  environmental  testing  of  general  supplies  and 
equipment,  including  those  in  AR  70-38'‘>  are: 

(1)  All  Army  equipment  is  r'  uired  to  perform  effectively  in  the 
climatic  design  types  described  in  Aj.  .0-38-  Other  required  climatic  design 
types  are  delineated  in  requirements  documents. 

(2)  Testing  materiel  in  natural  adverse  environments,  such  as  the 
arctic,  desert,  jungle,  seashore,  and  mountains,  is  costly  in  terms  of  man¬ 
power,  money,  materiel,  and  time,  and  is  normally  a  part  of  sei-vice  testing. 
During  TT,  the  maximum  amount  of  testing  is  performed  in  climatic  chambers  that 
simulate  the  adverse  environments. 

(3)  During  early  development  phases,  the  design  agency  may  conduct 
tests  (EDT)  tc  verify  that  certain  components  can  perform  adequately  under  the 
climatic  extremes,  or  it  may  request  that  the  tests  be  performed  by  the  U.S. 
Army  Test  and  Evaluation  Ccnmand  (TECOM).  These  data  should  be  evaluated  and 
accepted  when  valid  in  lieu  of  further  testing. 

(U)  Upon  receipt  of  the  prototype  for  TT,  all  environmental  tests 
required  by  the  requirements  documents  are  performed  if  they  are  within  the 
capabilities  of  the  environmental  chambers  and  if  they  are  economically 
feasible.  Data  from  earlier  testing  will  be  used  to  reduce  the  scope  of  fur¬ 
ther  testing,  if  the  data  are  usable  and  no  modifications  have  been  made  that 
will  affect  test  results.  Though  the  design  agency  may  resort  to  overtests,  it 
is  the  policy  to  confine  testing  to  simulation  of  the  conditions  specified  in 
AR  70-38  insofar  as  possible.  Standard  chamber  testing  of  general  supplies  and 
equipment  involves  high  amd  low  temperatures,  solar  radiation,  sand  and  dust, 
rain,  freezing  rain,  high  humidity,  and  salt  spray.  Improvised  facilities  are 
used  in  special  cases  such  as  measuring  static  electricity  generated  by  certain 
clothing  systems,  or  controlled  flame  tests  to  determine  textile  flammability 
resistance.  For  large  items,  salt  water  immersion  and  sea  air  exposure  tests 
are  conducted  in  conjunction  with  logistics-over-the-shore  (LOTS)  tests  at  Fort 
Story,  Virginia.  Fungus  tests  are  performed  for  TECOM  by  the  White  Sands 
Missile  Range  and  the  U.S.  Army  Chemical  Research,  Development,  and  Engineering 
Center. 


(5)  In  addition  to  potential  economical  advantages,  chamber  testing 
provides  controlled  extreme  conditions  that  are  desired  but  sometimes  not 
achieved  at  climatic  test  sites.  In  conducting  environmental  tests,  it  must  be 
renombered  that  AR  70"38  defines  criteria  and  conditions,  not  test  procedures. 
For  test  procedures,  first  choice  will  be  those  that  are  specially  devised  and 
described  in  TOPs/ITOPs;  otherwise,  MIL- STD-8IOD*  is  the  document  most  used  by 
the  test  activity.  Both  chamber  testing  and  environmental  testing  are  neces¬ 
sary.  Developmental  items  should  be  chambor-tested  before  being  tested  in 
natural  environments.  The  climatic  test  activities  (Yuma  Proving  Ground,  Cold 
Regions  Test  Center,  and  Tropic  Test  Center)  prepare  test  plans  for  the  field 
environmental  tests  conducted  at  the  specialized  sites. 

(6)  Environmental  testing  of  general  supplies  and  equipment  under  ad¬ 
verse  conditions  not  related  to  weather  includes:  vibration,  transportability. 
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off-road,  rough  handling,  electromagnetic  interference,  and 
nuclear-biological-chemical  (NBC)  conditions. 

d.  Common  subtests  contain  procedures  which  are,  or  can  be,  adapted  to 
apply  to  two  or  more  commodities  or  test  items.  Some  of  these,  including  com¬ 
mon  subtests  not  listed  in  TOP  Volume  10,  generally  apply  to  all  commodities  in 
the  category  of  general  supplies  and  equipment,  and  include  the  following 
subtests : 

(1)  Endurance 

(2)  Human  factors  evaluation 

(3)  Logistic  supportability 

(I4)  Operator  training  auid  familiarization 

(5)  Physical  characteristics 

(6)  Reliability 

(7)  Safety  evaluation 

(8)  Transportability 

(9)  Value  analysis 

Other  common  subtests,  applicable  only  to  certain  groups  o^  specialized  equip¬ 
ment,  include  the  following: 

(1)  Air  drop  capability 

(2)  Assembly  and  disassembly 

(3)  Compr.tibility  with  related  equipment 

(h)  Logistics-over-the-shore  / 

(5)  Line  haul 

(6)  Cargo-loading  adaptability 

(7)  Electrical  power  requirements 

(8)  Environmental  tests 

(9)  Electromagnetic  interference 

(10)  Food-acceptance  surveys 
3.  TEST  PLANNING. 

a.  The  TOPs  for  planning  tests  of  general  supplies  and  equipment  are 
included  in,  but  not  limited  to,  Volume  10.  Subtests  are  selected  from 
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pertinent  TOPs/ITOPs  to  evaluate  the  test  item  in  compliance  with  stated 
objectives,  even  though  test  data  may  be  derived  from  other  sources  (e.g.,  EDT, 
field  use).  Test  planning  requires  review  of  test  guidance  literature, 
familiarization  with  preceding  development  auid  test  phases,  study  of  test 
criteria,  and  selection  of  appropriate  samples,  methods,  sequence  of  tests, 
facilities,  and  test  equipment.  Risk/cost  and  safety  provisions  must  be  given 
prime  consideration.  Data  from  previous  amd  similar  tests  should  be  considered 
in  order  to  avoid  duplication  and  reduce  the  scope  of  further  testing. 

b.  To  write  a  test  plan,  first  refer  to  the  appropriate  system  TOP/IffOP 
for  the  item/system  that  is  to  be  tested.  This  system  TOP/ITOP  in  turn  will 
list  pertinent  common  TOPs/ITOPs  and  other  documents  suitable  for  testing  the 
itejn  (e.g.,  MIL-STD-SlOD) .  Write  the  test  plan  in  accordance  with  TECR  70-24* 
and  submit  it  to  TECOM  HQ  for  approval.  Local  guidance  for  writing  test  plans 
is  contained  in  the  Test  Directors’  Handbook  (CM  70-17’). 

4.  SAFETY  DURING  TESTING.  Safety  is  paramount  in  all  DoD  test  operations. 

Task  204  of  MIL-STD  882B^  states:  "...shall  perform  and  document  a  system 
hazard  auialysis  to  identify  hazards  and  assess  the  risk  of  the  total  system 
design. . . " 

All  tests  shall  therefore  be  reviewed  to  ensure  that: 

(a)  A  system  safety  hazard  analysis  shall  be  performed  to  ensura  that  per¬ 
tinent  safety  specifications  aind  criteria  are  verified  and  to  identify  unknown 
hazards  or  procedures  which  may  have  been  designed  into  the  system.  TOP 
1-1-060*  shall  be  used  as  a  guide  for  planning  and  conducting  the  subtest. 

(b)  The  testing  will  be  carried  out  in  a  safe  manner. 

(c)  All  additional  hazards  introduced  by  testing  procedures,  instrumenta¬ 
tion,  test  hardware,  etc.,  are  properly  identified  amd  minimized. 

U.S.  Army  Materiel  Command  (AMC)  implements  ooD  and  DA  policy  on  safety  during 
testing  through  AR  385"l6‘*  which  establishes  provisions  for  life  cycle 
verification  of  materiel  safety,  and  AMCR  ^85-100**  which  prescribes  the 
general  safety  rules  of  AMC  and  AMC  major  subordinate  commands.  Local  testing 
installations  publish  separate  safety  manuals  amd  regulations  to  parallel  the 
AMC  publications  with  respect  to  their  specific  safety  missions,  range 
facilities,  and  testing  sites.  Within  the  overall  scheme  of  development  and 
testing,  four  documents  are  developed  pertinent  to  safety: 

a.  Safety  Assessment  Report  (SAR) .  This  is  a  formal  summary  of  the 
safety  data  collected  during  the  design  and  development  of  the  system.  In  the 
SAR,  the  materiel  developer  summarizes  the  nazard  potential  of  the  item/system, 
provides  a  risk  assessment,  and  recommends  procedures  of  other  corrective  ac¬ 
tions  to  reduce  these  hazards  to  an  acceptable  level.  The  SAR  must  be  provided 
to  th-s  TT  agency  before  testing  begins. 

b.  Standing  Operating  Procedure  (SOP).  AMCR  385-IOO  states:  "...Before 
starting  any  operation  involving  ammunition,  explosives,  or  other  hazardous 
operation,  an  adequate  standing  operating  procedure  shall  be  developed  and  ap¬ 
proved  by  the  Commanding  Officer  of  the  activity  or  by  a  qualified  member  of 
the  staff  who  has  been  delegated  the  responsibility  for  review  of  and  authority 
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for  approval  of  standing  operating  procedures....”.  Each  test  activity/proving 
groimd  maintains  its  own  file  of  SOPs.  Before  conducting  a  test,  the  test 
director  must  be  sure  that  an  up-to-date  SOP  exists  to  ensure  safety  during  the 
testing  of  a  particular  item.  The  test  director  will  study  all -SOPs  which  per¬ 
tain  to  the  test/operation  in  which  he/she  will  participate,  and  will  follow 
all  instructions  contained  in  these  SOPs.  If  an  up-to-date  SOP  does  not  exist, 
the  test  director  will  immediately  begin  writing  one,  following  the  instruc¬ 
tions  contained  in  AMC  Reg  700-107‘’,  w/TECOM  supplement,  and  local  TT  agency 
SOP. 


(1)  Plan  tests  so  as  to  permit  minimum  hazard  (e.g.,  using  dummy  car¬ 
go  instead  of  live  ammunition,  using  simulants  instead  of  toxic  agents,  and 
using  diesel  instead  of  more  volatile  fuels  when  possible)  when  test  objectives 
can  be  met  in  that  manner.  Particular  precautions  are  instituted  for  specific 
tests,  such  as  fire-fighting  and  electrical  grounding  in  POL-related  tests, 
stand-by  craft  for  marine  tests,  and  medical  surveillance  for  toxic-agent 
tests.  Provisions  of  AMCR  385"100  apply  to  safety  in  all  testing.  Detailed 
plans  shall  include  safety  procedures,  precautions,  protection  (including 
clothing  and  immunization),  and  emergency  procedures  (including  evacuation  and 
medical)  as  necessary. 

(2)  SOPs  for  hazardous  operations  are  permanent  documents  which  can 
be  amended  by  changes  or  augmented  by  supplements.  SOPs  pertain  to  specific 
operations  or  tests  of  individual  items/syr terns.  By  regulation,  SOPs  must  be 
updated  every  2  years. 

c.  Safety  release.  This  is  a  formal  document  issued  to  a  user  test  or- 
gauaization  before  any  hands-on  use  or  maintenance  by  troops.  The  safety 
release  indicates  that  the  item/systera  is  safe  for  use  and  describes  the 
specific  hazards  of  the  item/system,  based  on  test  results,  inspections,  and 
system  safety  analysis.  Operational  limits  and  precautions  are  included.  The 
test  agency  uses  the  data  to  integrate  safety  in  test  controls  amd  procedures, 
and  to  determine  if  test  objectives  can  be  met  within  these  limits.  .A  limited 
safety  release  is  issued  when  further  safety  data  are  pending  (e.g.,  completion 
of  further  testing  cr  a  certain  safety  test),  and  restricts  a  certain  aspect  of 
the  test  (in  accordance  with  AR  385"l6).  AMC  and  HQ  TECOM  supplements  to  AR 
385-16  provide  more  information  about  the  issue  and  use  of  safety  releases. 

d.  Safety  confirmation  letter.  This  is  a  separate  document  or  part  of 
the  independent  evaluation  report  (lER)  or  position  letter  that  provides  the 
materiel  developer  with  the  DT  or  UT  agency  safety  findings  and  conclusions  and 
states  whether  the  specified  safety  requirements  are  met  (in  accordauice  with  AR 

385-16). 

5.  EXPERIMENTAL  DESIGN.  Commodity  engineering,  ser-zice,  and  environmental 
^  tes^s  for  general  supplies  and  equipment  are  specifically  designed  to  check  the 
functioning  of  a  specific  item  of  equipment  selected  from  this  category.  As 
part  of  such  testing,  each  commodity  item  is  subjected  to  individually  tailored 
operations  aoid  performance  subtests  and  selected  common  subtests  as  applicable. 
Each  of  these  subtests  consists  of  procedures  or  instructions  for  observing  and 
recording  the  technical  characteristics  of  a  given  commodity  as  determined  or 
evaluated  under  simulated  operational  and  environmental  conditions. 
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a.  Operations  and  performance  subtests  are  often  unique  to  the  item  being 
tested  and  are  not  contained  in  the  common  subtest  documents.  The  subtest 
•nethodology  and  instrmentation  techniques  used  are  organized  to  provide  data 
necessary  to  assess  and  determine  the  performance  qualities  of  the  test  item  as 
measured  against  the  specific  test  criteria  defined  in  the  test  directive, 
requirements  documents  or  other  governing  documents.  Test  design  is  a  sum  of 
the  information  obtained  from  previous  tests  of  similar  types  of  equipment  (if 
available)  plus  the  applied  knowledge  and  experience  of  the  person  writing  the 
test  procedure.  Risk  analysis  techniques  will  be  applied  during  the  planning 
and  conducting  of  all  suitability  tests. 

6.  INSTRUMENTATION  TECHNIQUES.  An  essential  step  in  testing  general  supplies 
and  equipment  is  the  development  and  acquisition  of  adequate  test  data  to 
determine  and  assess  the  suitability  of  the  individual  commodity  for  service 
test  or  for  Army  use.  To  acquire  the  data,  many  state-of-the-art  sampling 
devices  should  be  used.  Instrumentation  techniques  consist  of  assessing  the 
test  procedures  and  requirements  stated  in  the  test  directive,  requirements 
documents,  and  other  governing  documents  and  selecting  the  scimpling  devices 
that  will  best  provide  the  data.  All  instrumentation  used  for  data  acquisi¬ 
tion,  repair,  and  maincenance  shall  be  calibrated  and  certified  before  use. 

7.  STATISTICAL  TECHNIQUES.  The  function  of  statistics  is  to  separate,  as  far 
as  possible,  the  truth  from  error  by  narrowing  and  defining  the  region  of 
doubt.  Note,  however,  that  statistical  study  is  concerned  primarily  with  the 
precision  of  measurement.  It  cannot  reveal  anything  that  is  not  implicit  in 
the  data,  and  cannot  remove  systematic  errors  from  a  set  of  data.  Accuracy  is 
a  matter  of  test  methodology  and  equipment.  The  added  precision  afforded  by 
statistical  study  may  permit  detection  of  a  discrepancy,  which  is  a  necessary 
stepj  Because  of  the  wide  range  of  commodity  types  included  in  the  testing  of 
general  supplies  and  equipment,  the  statistical  techniques  presented  in  this 
TOP  are  general  in  nature  and  must  be  fitted  to  each  individual  commodity  test, 
as  required. 

a.  General  considerations  in  planning.  It  is  advantageous  for  the  test 
plan  author  and  test  director  to  consult  with  the  statistical  analyst  before 
conducting  the  test  to  determine  the  experimental  design  setup.  The  proper 
design  for  the  experiment  will  aid  in  controlling  bias  euid  in  measurement 
precision,  will  simplify  the  necessary  calculations  of  the  analysis,  and  will 
permit  clear  estimation  of  the  effects  of  the  factors.  Three  statistical  tools 
aid  in  developing  the  proper  design  for  an  experiment.  These  are  discussed  in 
the  following  paragraphs . 

(1)  An  important  class  of  experimental  design  is  characterized  by 
planned  grouping.  The  tool  of  planned  grouping  ca-i  be  used  to  take  advantage 
cf  naturally  homogeneous  groupings  in  materials,  machines,  time,  etc.,  to  take 
account  of  "background"  variables  which  are  not  direct  factors  in  the 
experiment. 

(2)  Randomization  is  an  arrangement  of  tests,  samples,  and  other  fac¬ 
tors  to  .'"imulate  a  chance  distribution,  reduce  interference  by  irrelevant  vari¬ 
ables,  and  yield  unbiased  statistical  data.  It  is  a  statistical  tool  which  en¬ 
sures  "Slid  estimates  of  experimental  error  and  makes  possible  the  application 
of  statistical  tests  of  significance  and  the  construction  of  confidence 
intervals. 
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(3)  Replication  is  the  repetition  of  an  experiment  or  procedure  at 
the  same  time  and  place.  Whore  a  measure  of  precision  must  be  obtained  from 
the  experiment,  replication  provides  this  measure.  In  addition,  it  provides  an 
opportunity  for  the  effects  of  uncontrolled  factors  to  balance  out  and  thus 
aids  randomization  as  a  bias-decreasing  tool. 

"b.  Measurement  of  data.  Measurements  cannot  be  made  with  complete  ac¬ 
curacy  of  precision.  The  terms  "accuracy"  and  "precision"  denote  tv'o  different 
ideas  which  are  inherent  in  the  measurement  method.  Accuracy  of  a  measurement 
method  refers  to  the  ability  of  the  method  to  provide  a  reading  which  confonts 
to  the  true  value,  whereas  precision  of  a  measurement  method  refers  to  the 
ability  of  the  method  to  provide  repeated  readings  which  to  a  degree  are  in 
sharp  agreement  with  each  other  regardless  of  whether  they  represent  the  "crue 
value.  If  a  magnitude  is  to  be  determined  with  accuracy  to  a  required  percent¬ 
age,  it  is  necessary  that  the  test  method  and  equipment  have  precision  of  this 
order;  that  is,  precision  is  a  prerequisite  to  accuracy,  but  precision  does  not 
guarantee  accuracy.  In  general,  the  test  objective  will  determine  the  reouire- 
ments  for  accuracy  and  precision,  and  these  in  turn  will  determine  the  test 
methods  and  equipment  to  be  used.  The  measured  value  of  a  characteristic  may 
be  represented  by  the  following  relationship: 

MEASURED  VALUE  -  TRUE  VALUE  +  ERROR  VALUE. 

c.  Sources  of  errors.  A  review  of  the  subject  of  error  sources  is  an  im¬ 
portant  step  in  understanding  the  error  value  and  finding  ways  to  reduce  it, 
and  as  a  means  of  estimating  the  validity  of  the  final  report.  Errors  may 
originate  in  a  variety  of  ways  and  may  be  categorized  as  gross  errors,  sys¬ 
tematic  errors,  and  random  errors. 

(1;  Gross  errors  include  mistakes  made  in  reading  and  recording  data. 
The  responsibility  usually  lias  with  the  test  personnel  for  slips  such  as  the 
gross  misreading  of  a  scale  or  transposing  figures  when  recording  the  result. 
Errors  of  this  type  may  be  of  any  amount  and  are  not  subject  to  mathematical 
treatment.  Two  things  can  be  done  to  avoid  such  difficulties:  exercise  care  in 
reading  and  recording  the  data;  make  two  or  more  determinations  of  the  desired 
quauitity,  preferably  at  different  reading  points  to  avoid  re-reading  with  the 
same  error.  Then,  if  the  readings  show  disagreement  by  aui  unreasonably  large 
amount,  the  situation  cam  be  investigated  and  the  bad  reading  eliminated. 

(2)  Systematic  errors  may  be  further  subdivided  into  instrumental  er¬ 
rors,  personnel  errors,  environmental  errors,  and  observational  errors. 

(a)  Instrumental  errors  are  due  to  shortcomings  of  the  instru¬ 
ment.  All  instrtunents  amd  standards  possess  inaccuracies  of  some  amount.  As 
supplied  by  the  maker,  a  tolerance  allowance  is  always  present  in  the  calibra¬ 
tion,  aurd  additional  inaccuracies  may  develop  with  use  and  age.  As  an  example, 
suppose  that  measurements  of  length  are  made  with  a  yardstick  after  a  small 
amount  has  been  cut  from  the  zero  end;  all  measurements  made  with  this 
yardstick  will  be  systematically  in  error  by  a  constant  amount.  Or,  as  another 
example,  the  ratio  arms  of  a  Wheatstone  bridge  may  have  an  actual  ratio  dif¬ 
ferent  from  the  marked  value.  This  causes  a  systematic  instrumental  error  of  a 
proportional  amoimt  for  all  measurements  using  these  arms.  An  indicating  in- 
stnunent,  such  as  a  volt -meter,  has  scale  errors.  These  errors  ai'e  generally 
different  at  different  parts  of  the  scale,  do  not  partake  of  either  the 
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constant  or  proportional  type,  and  must  be  expressed  by  a  correction  curve.  It 
is  importajit  to  recognize  the  possibility  of  such  errc’-s  when  making  precision 
measurements,  for  it  is  often  possible  to  eliminate  them,  or  at  least  to  reduce 
them  greatly  by  careful  planning  of  procedure,  application  of  correction  fac¬ 
tors,  and  careful  recalibration  of  the  instruments. 

(b)  Personnel  errors  are  systematic  errors  caused  by  misuse  or 
improper  loading  of  the  instruments.  A  good  instrument  used  in  an  un¬ 
intelligent  way  may  give  poor  results.  Measurement  shortcomings  can  be  traced, 
for  example,  to  failure  to  make  a  needed  zero  adjustment  in  a  bridge  or  meter, 
poor  initial  adjustment,  or  the  use  of  connecting  leads  of  too  high  resistance 
for  the  measurement  being  made.  Careless  or  uninformed  use  of  an  instrinnent 
may  also  cause  permanent  damage  as  a  result  of  overloading  and  overheating.  In 
this  case,  the  value  of  the  instrument,  and  of  future  as  well  as  present  read¬ 
ings,  is  depreciated  until  the  trouble  is  detected  and  repairs  are  made. 
Indicating  insti*uments  always  change  to  some  extent  when  connected  into  a  com¬ 
plete  circuit;  sometimes  the  effect  is  negligibly  small.  Sometimes  the  effect, 
though  not  negligible.,  can  be  corrected  by  computation.  At  other  times,  the 
presence  of  the  instrument  produces  so  great  a  change  in  the  circuit  that 
operating  conditions  in  the  circuit  are  altered  radically.  Test  personnel  must 
take  into  consideration  the  effect  that  the  measuring  equipment  has  on  the  cir¬ 
cuit,  auid  plan  the  measurements  accordingly. 

(c)  Environmental  errors  are  also  called  "errors  due  to  external 
conditions,"  i.e.,  conditions  external  to  the  measuring  device.  This  includes 
any  condition  in  the  region  surrounding  the  test  area  that  has  ar.  effect  on  the 
measurements.  One  common  source  of  variation  comes  from  t«aperature  chainges  of 
the  equipment.  Some  instruments  may  be  affected  by  humidity,  barometric  pres¬ 
sure,  the  earth’s  magnetic  field,  gravity,  stray  electric  and  magnetic  fields, 
or  other  environmental  conditions.  Actions  that  can  be  taken  to  eliminate  or 
at  least  reduce  undesirable  disturbances  consist  of  maintaining  environmental 
conditions  as  nearly  consteuit  as  possible,  using  equipment  inanime  to  environ¬ 
mental  effects,  and  applying  correction  factors.  It  should  be  noted  that  any 
of  these  methods  can  be  considered,  at  best.,  to  neutralize  the  major  part,  but 
not  all  of  the  error.  Correction  is  accomplished  to  a  "first  order"  of  ap¬ 
proximation,  but  leaves  "second  order"  or  "random"  errors. 

(d)  Observational  errors  or  '  errors  of  the  observer"  is  a  term 
that  recognizes  that  a  "personnel  equation"  exists  for  the  observer,  so  that 
people  using  the  same  equipment  for  duplicate  sets  of  measurements  do  not 
necessarily  produce  duplicate  results.  One  observer  may  tend  characteristical¬ 
ly  to  read  a  meter  higher  (or  lower)  than  the  correct  value,  possibly  because 
of  his  reading  angle  and  failure  to  eliminate  parallax.  Important  readings 
which  may  be  subject  to  this  type  of  error  should  be  shared  by  two  or  more  per¬ 
sonnel  to  minimize  the  possibility  of  constant  bias. 

(3)  Random  enrors  occur  in  a  manner  that  their  tine  of  occurrence  is 
unpredictable,  and  may  be  characterized,  for  example,  by  an  exponential  dis¬ 
tribution.  To  reduce  such  errors,  it  is  necessary  to  reduce  the  time  exposure 
(shorten  the  mission)  or  to  redesign  to  reduce  their  probability  of  occurrence. 
Corrective  action  usually  is  not  within  the  province  of  the  test  planner. 
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a.  Analysis  of  data.  A  larga  anount  of  data  is  collected  as  a  result  of 
testing.  Because  these  data  have  raeeming  only  in  comparison  with  similar  data, 
the  quantitative  measures  obtained  from  a  test  must  be  reduced  to  values  having 
units  which  are  acceptable  as  a  basis  for  comparisor*.  In  reducing  the  data, 
errors  which  would  affect  the  accuracy  of  the  results  must  be  identified  and 
compensated  for.  When  raw  data  have  been  reduced  to  workable  numbers,  the 
statistician,  using  proven  mathematical  methods,  arrives  at  a  conclusion.  The 
conclusion  may  be  a  statement  that  a  population  parameter  falls  within  an  in¬ 
terval  accompanied  by  a  statement  of  assurance  given  in  percent. 

b.  Presentation  of  data.  The  final  step  is  the  presentation  of  data.  It 
must  involve  thought  and  intelligence  in  its  preparation,  and  is  influenced  by 
the  capability,  the  ingenuity,  and  background  of  the  analyst.  The  test  of  good 
data  presentation  lies  in  its  usefulness  to  equipment  performance  ainalysts  who 
evaluate  the  data  relative  to  established  criteria  and  make  the  recommendations 
regarding  acceptability  of  equipment  performance. 


Recommended  changes  of  this  publication  should  be  forwarded  1 
to  Commander,  U.S.  Army  Test  and  Evaluation  Command,  ATTN: I 
AMSTE-TC-M,  Aberdeen  Proving  Ground,  MD  21005-5055- I 
Technical  information  can  be  obtained  from  the  preparing | 
activity:  Commander,  U.S.  Army  Combat  Systems  Test  Activityl 
ATTN:  STECS-DA-ID,  Aberdeen  Proving  Ground,  MD  21001-5059.j 
Additional  copies  are  available  from  the  Defense  Technical] 
Information  Center,  Cameron  Station,  Alexandria,  VA  2230h- | 
61I45.  This  document  is  identified  by  the  accession  number] 
(AD  No.)  printed  on  the  first  page.  _ [ 
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